Mean-field theory for a spin-glass model of neural networks: TAP free energy and paramagnetic to spin-glass transition

نویسنده

  • K Nakanishi
چکیده

An approach is proposed to the Hopfield model where the mean-field treatment is made for a given set of stored patterns (sample) and then the statistical average over samples is taken. This corresponds to the approach made by Thouless, Anderson and Palmer (TAP) to the infinite-range model of spin glasses. Taking into account the fact that in the Hopfield model there exist correlations between different elements of the interaction matrix, we obtain its TAP free energy explicitly, which consists of a series of terms exhibiting the cluster effect. Nature of the spin-glass transition in the model is also examined and compared with those given by the replica method as well as the cavity method. [email protected] [email protected] 1

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Boltzmann Machine Learning Using Mean Field Theory and Linear Response Correction

We present a new approximate learning algorithm for Boltzmann Machines, using a systematic expansion of the Gibbs free energy to second order in the weights. The linear response correction to the correlations is given by the Hessian of the Gibbs free energy. The computational complexity of the algorithm is cubic in the number of neurons. We compare the performance of the exact BM learning algor...

متن کامل

Complexity as the driving force for glassy transitions

The glass transition is considered within two toys models, a mean field spin glass and a directed polymer in a correlated random potential. In the spin glass model there occurs a dynamical transition, where the the system condenses in a state of lower entropy. The extensive entropy loss, called complexity or information entropy, is calculated by analysis of the metastable (TAP) states. This yie...

متن کامل

Critical behaviour and ultrametricity of Ising spin-glass with long-range interactions

Ising spin-glass systems with long-range interactions (J(r) ∼ r) are considered. A numerical study of the critical behaviour is presented in the non-mean-field region together with an analysis of the probability distribution of the overlaps and of the ultrametric structure of the space of pure states in the frozen phase. Also in presence of diverging thermodynamical fluctuations at the critical...

متن کامل

Zero-temperature TAP equations for the Ghatak-Sherrington model

The zero-temperature TAP equations for the spin-1 Ghatak-Sherrington model are investigated. The spin-glass energy density (ground state) is determined as a function of the anisotropy crystal field D for a large number of spins. This allows us to locate a first-order transition between the spin-glass and paramagnetic phases within a good accuracy. The total number of solutions is also determine...

متن کامل

Finite Connectivity Attractor Neural Networks

Abstract. We study a family of diluted attractor neural networks with a finite average number of (symmetric) connections per neuron. As in finite connectivity spin glasses, their equilibrium properties are described by order parameter functions, for which we derive an integral equation in replica symmetric (RS) approximation. A bifurcation analysis of this equation reveals the locations of the ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1997